Notice: the WebSM website has not been updated since the beginning of 2018.

Web Survey Bibliography

Title Does Order Really Make a Difference? The Impact of Respondent and Question Characteristics on Response Option Order Effects
Year 2003
Access date 06.05.2004
Abstract

Previous research on the effects of response option order has focused primarily on respondent characteristics such as respondent education, cognitive sophistication, and age, and question characteristics such as the type of question, with mixed results. This paper focuses on the effects of response option order across both respondent and question characteristics including respondent age, question subject, scale orientation, and question type in a Web based expenditure survey of parent and teen pairs. My research, like much of the previous research, finds mixed support for response option order effect in a web-based data collection. Overall, 33% of the parent questions and 43% of the teen questions appear to support the existence of response option order effects Specifically, both parents and teens are more susceptible to response option order effect when they are asked relationship-related questions rather than money-related questions, and when answering attitude questions rather than frequency questions. However the results for scale orientation show differences between parents and teens. Here, parents are more likely to choose the same place on the response scale, independent of the response option wording, for horizontally oriented scales rather than vertically oriented scales, while teens are more likely to choose the same place for vertically oriented scales rather than horizontally oriented scales. Few significant within group age results were found. This is expected due to the lack of variation within teen and parent respondents. These findings show that there is an age effect between age groups, but the within group age distribution does not permit significant within group variation.

Access/Direct link

Homepage - conference (abstract)

Year of publication2003
2003
Bibliographic typeConferences, workshops, tutorials, presentations
Conferences, workshops, tutorials, presentations
Print

Web survey bibliography - The American Association for Public Opinion Research (AAPOR) 58th Annual Conference, 2003 (20)